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C^ i Abstract 

The maximum principle for optimal control problems of fully coupled forward- 
backward doubly stochastic differential equations (FBDSDEs in short) in the global 
Q^ ' form is obtained, under the assumptions that the diffusion coefficients do not contain 

the control variable, but the control domain need not to be convex. We apply our 
stochastic maximum principle (SMP in short) to investigate the optimal control prob- 

in ■ 

i^ ' lems of a class of stochastic partial differential equations (SPDEs in short). And as 

o : 

an example of the SMP, we solve a kind of forward-backward doubly stochastic linear 

quadratic optimal control problems as well. In the last section, we use the solution of 

p\ ' FBDSDEs to get the explicit form of the optimal control for linear quadratic stochas- 

5^ , tic optimal control problem and open-loop Nash equilibrium point for nonzero sum 

differential games problem. 
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1 Introduction 

It is well known that optimal control problem is one of the central themes of control 
science. The necessary conditions of optimal problem were established for deterministic 
control system by Pontryakin's group [24] in the 1950's and 1960's. Since then, a lot of work 
has been done on the forward stochastic system such as Kushner 13], Bismut [5], Bensoussan 
[2, 3], Haussmann [9, 10] and Peng [20] etc. 

Peng [20] studied the following type of stochastic optimal control problem. Minimize a 
cost functione 

J(f(.)) =E / l{xt,Vt)dt + BihT), 
Jo 

subject to 

dxt = g (t, xt, vt) dt + a (t, xt, Vt) dBt, .^ ^. 

over an admissible control domain which need not be convex, and the diffusion coefficients 
contain the control variable. In his paper, by spike variational method and the second order 
adjoint equations, Peng [20] obtained a general stochastic maximum principle for the above 
optimal control problem. It was just the adjoint equations in stochastic optimal control 
problems that motivated the famous theory of backward stochastic differential equations 
(BSDEs in short) (see [18]). Later Peng [21] studied a stochastic optimal control problem 
where state variables are described by the system of forward and backward SDEs, that is 

dxt = f {t, Xt, Vt) dt + a (t, Xt, Vt) dWt, 

Xq X, ( ^ o\ 

dyt = g{t,xt,vt)dt + ZtdWt, 

Vt = y, 

where x and y are given deterministic constants. The optimal control problem is to minimize 
the cost function 



J (t;(.)) = E 



T 



I (t, Xt, Vt, Vt) dt + h (xt) + 7 iVo) 



over an admissible control domain which is convex. Xu [28] studied the following non-fully 
coupled forward-backward stochastic control system 

dxt = f {t, Xt, Vt) dt + a {t, Xt) dWt, 

Xq X, (T "i^ 

dyt = g{t,xt,yt,zt,vt)dt + ZtdWt, 
yT = h (xt) ■ 

The optimal control problem is to minimize the cost function 

J(v(.)) =E-f{yo), 
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over Uadi but the control domain is non-convex. Wu [26] firstly gave the maximum principle 
for optimal control problem of fully coupled forward-backward stochastic system 

dxf = / (t, Xi, yt, zt, vt) dt + o- (t, Xt, yt, Zt, Vt) dBt, 
d|/t = -g (t, xt, Vt, Zt, Vt) dt + ZtdBt, 
xo = X, yT = i, 

where ^ is a random variable and the cost function 



;i-4) 



J (t;(.)) = E 



L {t, Xt, yt, Zt, Vt) dt + $ (xt) + h (yo) 



Uo 



The optimal control problem is to minimize the cost function J (v(.)) over an admissible 
control domain which is convex. Ji and Zhou [12] obtained a maximum principle for stochas- 
tic optimal control of non-fully coupled forward-backward stochastic system with terminal 
state constraints. Shi and Wu [25] studied the maximum principle for fully coupled forward- 
backward stochastic system 



dxt = b {t, Xt, yt, Zt, Vt) dt + a {t, xt, yt, zt) dBt, 
dyt = -f (t, Xt, yt, Zt, Vt) dt + ZtdBt, 
xo = X, yT = h {xt) ■ 



;i.5) 



and the cost function is 



E 



/ (t, Xt, yt, Zt, Vt) dt + ^ (xt) + 7 ivo) 



uo 



The control domain is non-convex but the forward diffusion does not contain the control 
variable. For more details in this field, see Yong and Zhou [29]. 

In order to provide a probabilistic interpretation for the solutions of a class of semilinear 
stochastic partial differential equations (SPDEs in short), Pardoux and Peng [19] introduced 
the following backward doubly stochastic differential equation (BDSDE in short): 

T T T 



Yt = ^+ f{s,Ys,Zs)ds+ g{s,Y„Z,)dB. 



ZAW„ <t<T. 



(1.6) 

Note that the integral with respect to {5^} is a "backward Ito integral" and the integral with 
respect to {Wt} is a standard forward Ito integral. These two types of integrals are particular 
cases of the Ito-Skorohod integral (for details see [15]). Peng and Shi [22] introduced a type 
of time-symmetric forward-backward stochastic differential equations, i.e., so-called fully 
coupled forward-backward doubly stochastic differential equations (FBDSDEs in short): 



t t t ^ 

Vt = x + J f{s,ys,Ys,Zs,Zs)ds + J g{s,ys,Ys,Zs,Zs)dWs- J ZsdBs, 



T T T 

Yt = h{yT) + jF{s,ys,Ys,Zs,Zs)ds + jG{s,ys,Ys,Zs,Zs)dBs + J ZsdWs 
t t t 



;i.7) 



In FBDSDEs (1.7), the forward equation is "forward" with respect to a standard stochastic 
integral dWt, as well as "backward" with respect to a backward stochastic integral dBf, 
the coupled "backward equation" is "forward" under the backward stochastic integral dB^ 
and "backward" under the forward one. In other words, both the forward equation and the 
backward one are types of BDSDE (1.6) with different directions of stochastic integrals. 
So (1.7) provides a very general framework of fully coupled forward-backward stochastic 
systems. Peng and Shi [22] proved the existence and uniqueness of solutions to FBDSDEs 
(1.7) with arbitrarily fixed time duration under some monotone assumptions. FBDSDEs 
(1.7) can provide a probabilistic interpretation for the solutions of a class of quasilinear 
SPDEs. 

As we have known, stochastic control problem of the SPDEs arising from partial obser- 
vation control has been studied by Mortensen [9], using a dynamic programming approach, 
and subsequently by Bensoussan, using a maximum principle method. See [4], [16] and the 
references therein for more information. Our approach differs from the one of Bensoussan. 
More precisely, we relate the FBDSDEs to one kind of SPDEs with control variables where 
the control systems of SPDEs can be transformed to the relevant control systems of FBDS- 
DEs. To our knowledge, this is the first time to treat the optimal control problems of SPDEs 
from a new perspective of FBDSDEs. It is worth mentioning that the quasilinear SPDEs in 
[17] 0ksendal considered can just be related to our partially coupled FBDSDEs. 

Besides, in Section 6 we investigate the nonzero sum stochastic differential game problem. 
This problem have been considered by Friedman [8], Bensoussan [1] and Eisele [7]. For 
stochastic case Hammadene [11] and Wu [27] (for more information see references therein) 
showed existence result of Nash equilibrium point under some assumptions, respectively. 
Here, we extend their result to doubly stochastic case in which we can regard the backward 
filtration as the disturbed information come from outside the "control system". 

In this paper, we consider the following fully coupled forward-backward doubly stochastic 
control system 



= ^ + /o / (-^i Vs^ ^s, Zs, Zs, Vs) ds + /g g (s, y^, Ys, Zs, Z^) dW^ - £ z^dB^, 
= h{yT) + J^ F{s,ys,Ys,Zs,Zs,Vs)ds + J^ G {s,ys,Ys, Zs, Zs) dBs + J^ Z^dWs- 

(U 
Our optimal control problem is to minimize the cost function: 



J {v^.)) = E 



T 

/ (t, yt, Yt, zt, Zt, vt) dt + $ (yr) + 7 (Yo) 



over an admissible control domain which need not be convex. It is obvious that (1.8) covers 
(1.3) and (1.5), so (1.8) can describe more intricate control systems. As for the fully coupled 
forward-backward doubly stochastic control systems such as (1.8) whose diffusion coefficients 
contain the control variables, this issue will be carried out in our future publications. 

The notable difficulties to obtain the maximum principles for the fully coupled forward- 
backward doubly stochastic control systems within non-convex control domains are how 
to use the spike variational method to get variational equations with enough high order 



estimates and how to use the duahty technique to obtain the adjoint equations. On account 
of the quadruple of variables in the FBDSDEs, we can not directly apply the methods used 
in [25], [26] and [28]. In this paper, by virtue of the results of FBDSDEs in [22], we can 
ensure the existence and uniqueness of the solutions for the adjoint FBDSDEs which are 
obtained by applying the duality technique to the variational equations. Besides, we apply 
the technique of FBDSDEs to get the enough high order estimates for the solutions of the 
variational equations. 

This paper is organized as follows. In Section 2, we state the problems and some as- 
sumptions. In Section 3, we study the variational equations and variational inequalities. 
In Section 4, a stochastic maximum principle in global form is obtained, subsequently, an 
example of this kind of control problems is given in this section. As an application, we study 
the optimal control problem of a kind of SPDEs with control variable by the approach of 
FBDSDEs in Section 5. Lastly, we give the explicit form of Nash equilibrium point for a 
kind of stochastic differential game problem. 

For the simplicity of notations, we only consider the case where both y and Y are one- 
dimensional, and the control v is also one-dimensional. While in order to give the general 
results, we consider the multi-dimensional case in Section 6. 

2 Statement of the problem 

Let {Q,J-',P) be a complete probability space, and [0,r] be a given time duration 
throughout this paper. Let {Wf, < t < T} and {B^; < t < T} be two mutually inde- 
pendent standard Brownian motions defined on {Q,J^,P), with values respectively in R^ 
and in R^ Let A/" denote the class of P-null elements of J-". For each t G [0, T], we define 

where Jf" = A/" V a {Wr -Wo;0<r< t}, J^^j, = Af W a {Br - Bt;t < r < T}. Note that 
the collection {J^t,t ^ [0)^]} is neither increasing nor decreasing, and it does not constitute 
a classical filtration. We introduce the following 

Definition 1. A stochastic process X = {Xt;t > 0} is called J-'t-progressively measur- 
able, if for any t > 0, X on Q x [0,t] is measurable with respect to [J-'^ x i3([0,t])) V 
(j-,^xS([t,T])). 

Let M^ (0, T; R") denote the space of all (classes of dP (g5 dt a.e. equal) R"-valued J-'t- 
progressively measurable stochastic processes {vt;t G [0,T]} which satisfy 

E / \vtf dt < cx). 
Jo 

Obviously M^ (0, T; R") is a Hilbert space. For a given u E M^ (O, T; R'^) and v e M^ (O, T; R') , 
one can define the (standard) forward Ito's integral J^ UgdWs and the backward Ito's integral 
J^VsdBs. They are both in M^ (0,T; R), (see [14] for details). 



Let L^ {Q,J-'t, P', R) denote the space of all J-V-measurable one-valued random variable 
^ satisfying E |^| < oo. Under this framework, we consider the following forward-backward 
doubly stochastic control system. 

dyt = f (t, yt, Yt, Zt, Zt, Vt) dt + g (t, yt, Yu Zt, Zt) dWt - ZtdBt, 

dYt = -F (t, y,, Yt, Zt, Zt, Vt) dt - G (t, yt, Yt, Zt, Zt) dS, + ZtdWt, (2.1) 

y^ = x, YT = h{yT), te[0,T], 

where {y{.), Yi^.), Z(.), Z(.), f(.)) gRxRxRxR xR, xGRisa given constant, T > 0, 

F : [0, T] X R X R X R' X R'^ X R ^ R, 

/ : [0, T] X R X R X R' X R'^ X R ^ R, 

G : [0, T] X R X R X R' X R'^ X R ^ R\ 

g : [0, T] X R X R X R' X R'^ X R -> R'^, 

h : R ^ R. 

Let U he a nonempty subset of R. We define the admissible control set 

Uad= {v(.) e M^(0,T;R); VteU, 0<t<T, a.e., a.s.} . 

Our optimal control problem is to minimize the cost function: 



J (t;(.)) = E 



over hlad, where 



7 



/ I (t, yt, Yt, Zt, Zt, Vt) dt + $ (yr) + 7 (Yq) 
Jo 

[0, T] X R X R X R' X R"^ X R ^ R, 
R^ R, 
R^ R. 



f2.2l 



An admissible control W(.) is called an optimal control if it attains the minimum over Uad- 
That is to say, we want to find a W(.) such that 

(2.1) is called the state equation, the solution {yt,Yt, Zt, Zt) corresponding to M(.) is called 
the optimal trajectory. 



Next we will give some notations: 

/ y \ 

c = 



Y 

z 



A (t, C) 



(^,0 



f 

-G 
\ 9 J 

We use the usual inner product (■,•) and Euclidean norm |-| in R, R' and R"^. All the 
equalities and inequalities mentioned in this paper are in the sense of dt ® dP almost surely 
on [0, T] X Q. We assume that 
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(HI) For each C G R^+^+'+'^, A{-,() is an J-'t-measurable process defined on [0,T] with 
A{-,0) G M2 (0, T; Ri+i+'+'^) . 

(H2) A (t, C) and h (y) satisfy Lipschitz conditions: there exists a constant A; > 0, such that 

\A{tX)-A{t,C}\<k\C-C\, VC, CeRi+i+'+^ VtG[0,T], 

The following monotonic conditions introduced in [17], are the main assumptions in this 
paper. 

r {A{t,0 - A{tx) x - C) < -^^\c - c\\ 

(H3) ^ \fC={y,Y,z,Z), C= {y,Y,z,Z) G R x R x R'xR^ VtG[0,T]. 
[ {h{y)-h{y),y-y)>0, Wy, yeK, 

or 

r {A{tx)-A{t,c),c-c)>f^\c-c\\ 

(H3)' ^ \/C={y,Y,z,Z), C= (y,V',^,^) gRxRxR'xR^ VtG[0,T]. 
[ (/i(t/)-/i(y),2/-y)<0, Vy, yen, 

where /i is a positive constant. 

Proposition 2. For any g'wen admissible control f(.), t(;e assume (HI), (H2) and (H3) (or 
(HI), (H2) and (H3)') hold. Then FBDSDE (2.1) has a unique solution {yt,Yt, Zt, Zt) G 
M2(0,T;R1+i+'+'^). 

The proof is referred to [17]. We need a farther assumption as follows: 

(H4) F, /, G, g, h, I, $, 7 are continuously differentiable with respect to {y, Y, z, Z) , y and 
Y. They and all their derivatives are bounded by a constant C. 

Lastly, we need the following extension of Ito's formula (for details see [14]). 
Proposition 3. Let 

aeS^ (0, T; R'') , /? G M^ (O, T; R^) , 7 G M^ (O, T; R^^') ,6 e M^ (O, T; R'^^^) 

satisfy: 

at = ao+ [ Ms + / IsdBs + / 6sdWs. 0<t<T. 
Jo Jo Jo 

Then 

|2 



at 



\aof + 2 I (a„/?,)& + 2 f (a„7,d5,)+2 f {as^SsdWs 
Jo Jo Jo 



t pt 

\-is? ds+ / \6s\^ ds, 
Jo 



Elctil^ = E|ao|^ + 2E / {as, /3s) ds -E {-fs^ds + E \Ss\'^ ds. 

Jo Jo Jo 



Here S^ (0,T; R^) denotes the space of (classes of dP (8> dt a.e. equal) all J-'rprogressively 
measurable A;-dimensional processes v with 

E I sup \vt\ ) < oo. 

\0<t<T / 

3 Variational equations and variational inequalities 

Suppose {yt,Yt, Zt, Zt,Ut) is the solution to our optimal control problem. We introduce 
the following spike variational control: 

^e ^ f V, T <t<r + e, 
* \ Ut, otherwise, 

where e > is sufficiently small, t & [0, ?"]• v is an arbitrary Jv-measurable random variable 
with values inU, < t <T, and sup \v {uj)\ < oo Let {yf, Y^ , zf, Z[) be the trajectory of the 

control system (2.1) corresponding to the control uf. 

For convenience, we use the following notations in this paper: 



^y 


= Ey{t,yt,Yt,zt,Zt,ut) 


S,«) = 


= Ey{t,yt,Yt,Zt,Zt,Ut) 


H(«0 = 


= E{t,yt,Yt,zt,Zt,Ut), 


2«) = 


= E{t,yt,Yt,Zt,Zt,Ut), 




etc, 



where S = f, F, g, G, respectively. We introduce the following variational equations: 

f dyj = [fyyj + fyY,' + /,4 + fzY,' + f (ut) - f (u,)] dt 
+ [QyVl + QyY^^ + g,zl + gzZ}] dWt - zldBt, 

% = 0' /o-|\ 

dy/ = -[Fyyl + FYY,' + F,zl + FzZl + F{ut)-F{ut)]dt ^''■'> 

- [Gyyl + GyY^' + G,zl + GzZ}] dBt + ZldW^ 
Yt = hyMVT- 

Owing to (H4), it is easy to check that the variational equation (3.1) same as (2.1), also satis- 
fies (HI), (H2) and (H3). Thus by Proposition 2, there exists a unique solution [y], Y^, zl, Z}) G 
RxRxRxR,0<t<T, satisfying (3.1). The variational inequalities can be derived 

from the fact J ( wf ^ 1 — J ('U(.)) > 0. The following lemmas play important roles to establish 

the inequalities. 

Lemma 4. We assume (H1)-(H4) hold. Then we have 

E / \yl\'dt<Ge, (3.2) 

Jo 



E \Yt^\^dt<Ce, (3.3) 

Jo 

i-T 

E \zl\^dt<Ce, (3.4) 

Jo 

E I \Zl\^ dt<Ce. (3.5) 

Jo 

where C > is some constant. 

Proof. Using the Ito's formula to {yl, Y^^) , it follows that 

= E [ [fyy] + fyY,' + f^z] + fzZl) r,Mt 
Jo 

-E I [Fyyl + Fyy/ + F^zl + FzZ]) yldt 
Jo 

rp 

-E I [Gyy] + GyYI + G^z] + GzZ]) z^dt 
Jo 

+E / {gyyl + gyY,' + g^zl + (?z^/) Zldt 
Jo 

+E [ U{ul)-f{u,))Y^dt 
Jo 

~E [ {F{v^)-F{ut))y]dt. 
Jo 

Since (3.1) satisfies the monotonic condition (H3), it is easy to see that 

E{\y'^\'hy{yT))+fiEj (|^if + jy/f + |^i| ^ |Z/|') dt 

< e[ {f{ut)-f{ut))Y,'dt-E [ {F{ut)-F{ut))yldt 
Jo Jo 

< -E r\f{ut)-f{u,)fdt+i^E r\Y,'\'dt 

A* Jo ^ Jo 

+-E [ \F{ut)-F{u,)fdt + ^E r\yl\'dt. 



(3.6) 



(3.7) 
From (H4) and (3.7), it is easy to know that (3.2)-(3.5) hold. The proof is complete. □ 
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However, the order of the estimate for {y],Y^,zl,Zl) is too low to get the variational 
inequalities. We need to give some more elaborate estimates. For that, we firstly give the 
following lemma. 



Lemma 5. Assuming (H1)-(H4) hold, then we have 

sup (E\yl\')<Ce, 

0<t<T ^ ^ 

sup (Elr/f) < Ce. 



0<t<T 



Proof. Squaring both sides of 

yl + / zldB, = [ [fyvl + fvYl + f.z] + fzZ] + / «) - / («,)) ds 
Jo Jo 



+ I {gyVl + 9yYI + g,zl + gzZ]) dWs 
Jo 



noting that 

E 
we have 



y] j^ zldBs =E E-^' U j^ zldBA =E y^E^* H zldB, 

E|yif + E Tl^ll'ds 
Jo 

= E[[ {fyyl + fyY,' + f^zl + fzZl + / «) - / K)) ds 
Jo 

+ / {gyVl + 9yY,^ + g.zl + gzZl) dWs]' 
Jo 



< CE 



+CE 



Thus 



o<«<r 
By the similar argument, we can have 



(/K)-/(«.))d5 



sup fEb.^l^) <C£. 

<i<T V / 



ds 



sup fE|y/|^) <Ce. 



0<t<T 



(3.8) 
(3.9) 



The proof is complete. □ 
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Lemma 6. Assuming (H1)-(H4) hold, then we have 

Ef sup \ylA <Ce, 

\0<t<T / 



E( sup Ir/I^ ) <Ce. 

KO<t<T 



(3.10) 
(3.11) 



Proof. Squaring both sides of 



Vt 



[ {fyVl + /yn' + /.4 + fzZl + / K) - f («,)) ds 
Jo 

+ I [gyVl + 9yY} + g,zl + gzZ]) dW^ - / ^d^,, 
Jo Jo 



we have 



\yl\' < 3(^J^{fyyl + fyY,' + ^zl + fzZl + f{ul)-f{u,))ds^ 

+3 n {gyVl + QyY^ + g^zl + gzZl) dw)\ + 3 (j^ zldB^ 

< 3t / (/,t/l + fyY} + /,4 + /zZ] + / «) - / {us)y ds 
Jo 

+3n {gyyl + gyY^'+g,zl+gzZl)dW?j + 3 ("^ zldB. 



zldB, 



< C 



.1|2 



-1|2 , |^1|2 



1|2 



y,Y + kH +I^.T + l/«)-/(^ 



ds 



+3 r^ ((7,2/1 + dvYs + 9zzl + gzZ]) dw)j 



+6 



/„ ^'^N "Hi 



^ds, , , 



then 



sup |y,^|' < cf \\yl\^ + \Y^\^ + \zl\^ + \zl\^ + \f[ul)-f{u, 



0<t<T 



ds + 6 



zldB, 



+3 sup ( / {gyvl + gyY} + g.z] + gzZ]) dW^] +3 sup ( / zldB, 

0<t<T \Jo J 0<t<T \Jt 



i-T 



< C 



.1|2 



-1|2 , |.1|2 



1|2 



i/.T + |nT + kH +I^.T + !/«)- /K)l 



ds + 6f /" 4d5, 



+3 ( sup 

V0<«T 



/ {gyvl + gyY^ + ^,^1 + gzZ]) dWs 

Jo 



+ 3 ( sup 

VO<t<T 



zldBs 
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where C > is some constant. Hereafter, C will be some generic constant, which can be 
different from line to line. Taking expectation, by B-D-G inequality and Holder inequality, 
it follows that 



,1|2 



.1|2 



'1|2 , I 1|2 



.1|2 



E(sup y/n < CE/ 2/,Y + Fs + ^i +^i +l/«)-/(^«)l^ 

vO<t<T / Jo '- 



ds + 6E / \zl\ ds 



+CE [ \gy^+gyY,^+g,zl+gzZl\'ds + CE [ \zl\' ds 
Jo Jo 



< CE 



T 



\yl\' + lYs 



1 |2 I 1 |2 



\zl\ 



T 



ds + CE \f{ul)-f{u,)\'ds. 



From Lemma 4, (3.10) holds. By the similar argument, we can prove (3.11). Squaring both 
sides of 

Y; = hyMy'r + l^ {Fyyl + FyY} + F,zl + FzZl + F{if;)-F{us))ds 

+ [ {Gyyl + GyYl + G,zl + GzZl)dB,- f Z\dW,, 
Jt Jt 



it follows that 



|V/r < ^hy (yT) y'rl' + 5 (^J^ [Fyy] + FyY} + F^z] + FzZ] + F {uD - F {u,)) ds^ 
+b(j {Gyyl + GYY^ + G,z] + GzZl)dB)j + 5 (J ZldW^ +5 (J 



5( / ZldWs 



Thus 



sup |y/|' < 5\hy{yT)y'T\^ + 5( [ ZldWs] +5 sup ( [ ZldW, 

0<t<T \Jo / 0<t<T \Jo 

+5 (T-t)J^ I Fyyl + FyY} + F,^ + FzZ] + F «) - 
+5 sup ( [ {Gyyl + GyY^' + G-^z] + GzZ]) ds)] . 

0<t<T \Jt / 

Taking expectation and by B-D-G inequality, it follows that 

E(sup|y/n < 5E\hy{yT)yTf + 5E [ \Zl\^ ds + GE [ |Z]fds 

Vo<t<T / Jo Jo 



Fiu^rds 



-CE 



T 



.1|2 



a|2 , |vl|2 



KT + Uir + \Zir + \F (ul) - F ius)\' ds 



j-T 

+GE / I Gyy] + GyY^ + G.z] + GzZl\^ ds. 
Jo 
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Noting (3.10), from Lemma 4 and Lemma 5, it is easy to see that (3.11) holds. The proof 
is complete. □ Next, we will give some elaborate estimates for {y^, Y^^, z], Z^) by virtue of 
the techniques of FBDSDEs. 



Lemma 7. Assuming (H1)-(H4) hold, then we have 



E 



E 



/ \yl\'dt<Cel, 
Jo 

/ \Yl\^dt<Ce^, 
Jo 



E 



E 



T 



\z}\^ dt< Get. 



\Zl\^dt< Ce^. 



Proof. By (3.7), we have 



E 



y'rf hy (vt)] + fiB J (^\yl\' + \Yl\'+\zl\'+\Zl\') 

< e[ {f{ut)-f{ut))Yldt-E [ {F{ut)-F{ut))yldt 
Jo Jo 

sup |F/| / \f{ut)-f{ut)\dt 

<T Jo 

sup \yl\dt f \F{ut)-F{ut)\dt 

<t<T Jo 

T \ 2 

\F{ul)-F{ut)\dt 



dt 



< E 

+E 



0<t<T 



E ( sup \yl\ 

0<t<T 



+ 



e( sup |y; 

\0<t<T 



1|2 



E 



T X 2' 

\fiut)-fiu,)\dt 



< Ce'i. 



(3.12) 

(3.13) 
(3.14) 
(3.15) 



where C is a sufficiently large positive constant. From (H3), the desired results are obtained. 
D 

In order to obtain variational inequality, we need the following lemma. 

Lemma 8. Assuming (H1)-(H4) hold, then we have 



E 



/ \yt-yt-yl\'^ dt<Cel, 

Jo 



(3.16) 
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E 



f \Y^' -Yt-Yt^\^dt<Ce'^, 
Jo 

I \zl — Zt — zl\ dt < Ce: 2 , 
Jo 



E 



Jo 



Zl-Zt-Zl? dt<Cei., 



sup 
o<«r 



^\yt-yt-yl\ 



sup 

o<i<r L 



E |y/ -Yt-Y, 
Proof. For notational convenience, we denote 



1|2 



<C£2, 



<C5i 



yt = yl-yt-y]-, 



Yt -- 


- ^t - ^t- ^t ^ 


Zt = 


- Zt - Zt- Zt, 


Zt -- 


= Zt — Zt — Zf 



We have the following FBDSDEs 



yt 



fyys + fyYs + fzZs + fzZs 



ds 



VMs 



Hsds 



+ 



9yys + gyXs + g-Js + gzZs 



dW. 



zAB, 



T 



Yt = h (2/1) -h[yT + y^r) + / [Fylls + FyY^ + F,z, + FzZ, 

+ / Gyys + GyYs + G.is + GzZ, dS. 



ds 



V'ds+ / i/,ds 



+ / [hy [yr + ?/t^) - hy (yT)) y^dA 
Jo 



T 



ZsdWs, 



where 
fy 
fy 

L 

~fz 



(3.17) 

(3.18) 

(3.19) 
(3.20) 
(3.21) 



/ fy (ys + yl + Ay„ n + Y} + ay;, z, + zl + A5„ z, + z] + az„ m^) dA, 
fy (ys + yl + Xys, Ys + Y} + XY^, Zs + z] + A5„ Z, + Z] + AZ„ <) dA, 



/. ( 1/s + yl + Ay„ y; + y;^ + ay;, z, + zl + Xzs, z^ + zl + az„ < ) dA 



fz (ys + ?/l + Xys, Ys + f; + XYs, Zs + z^ + Xzs, Zs + Z] + AZ„ mM dA, 



14 



'Y 



/ Fy [vs + y] + Xys, Y^ + F/ + Af,, z, + z] + A5„ Z, + Z] + AZ„ <) dA, 
Fy (vs + yl + Xys, Ys + F,^ + ay;, Zs + 2;] + Xzs, Zs + Z] + XZs, ul) dA 



i^. ( ?/s + yl + Xys, Y, + y/ + ay;, 2, + z] + A5„ Z, + Z] + AZ„ < ) dA 



Fz (ys + yl + Xys, Ys + F,^ + AF,, Zs + zl + Xzs, Z, + Z] + AZ„ ul) dA 



9y 
9z 
9z 

Gy 

Gy 
Gz 



9y (ys + yl + Xys, Ys + F/ + AF,, Zs + zl + Xzs, Zs + Z] + AZJ dA 



/ 9y (^ys + yl + Xys, Ys + F,i + AF,, Zs + ^1 + Xzs, Zs + Z] + AZ,) dA, 
9z (ys + yl + Ay„ F, + f; + AF„ 2;, + zl + A5„ Z, + Z] + AZ,) dA, 



/ 9z (^ys + yl + Xys, Ys + F,^ + AF,, Zs + 4 + A5„ Z, + Z] + AZ,) dA, 



Gy (ys + yl + Xys, Ys + F/ + AF,, 2;, + zl + A5„ Z, + Z] + AZJ dA, 



Cy (ys + yl + Ay„ Ys + F/ + AF,, Zs + z] + A5„ Z, + Z] + AZJ dA, 



Vf 



/ G, (^2/, + yl + Ay„ F, + f; + AF,, z, + zl + A5„ Z, + Z] + AZ,) dA, 
f Gz (^ys + yl + Ay„ F, + F.^ + AF,, Zs + ^1 + Xzs, Zs + Z] + AZ,) dA, 

= [ [fy {Vs + Ayl, F, + AF,i, ^, + Xzl,Zs + AZ], <) - /,] yldX 
Jo 

+ [ [Iy {ys + Xyl, Ys + XY},Zs + A^l, Z, + AZ], <) - fy] Y}dX 
Jo 

+ [ [fz [Vs + Xyl, Ys + AF/, Zs + Xzl, Zs + XZ], <) - /,] zldX 
Jo 

+ / [fz [ys + Ayl, Ys + AF,i, Zs + A^l, Z, + AZ], <) - fz] Z.MA, 
Jo 
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H. 






-- / [9y [Vs + 2/1 A, y, + AY;^ , Zs + Xzl , Zs + XZl) - Qy] yldX 
Jo 

+ / [9Y {Vs + ylX, n + XY,\ zs + Xzl Zs + XZ]) - gy] F/dA 

+ / [Qz [Vs + ?/lA, Ys + Ay,\ 2, + A^l, Z, + xzl) - g,] zldX 
Jo 

+ [ [gz {Vs + ylX, Ys + XY}, Zs + Xzl, Zs + xzl) - gz] Z^dA, 
Jo 

[ [Fy {y, + ylX, Ys + XY^z^ + Az], Z, + XZ^ul) - Fy] yldX 
Jo 

+ / [Fy {ys + ylX, Ys + XY^z^ + XzlZ^ + AZ], <) - Fy] Y^dX 
Jo 

+ / [F. [vs + ylA, n + XY}, Zs + A^l, Zs + AZ], <) - F,] z.MA 
Jo 

+ /" [Fz {ys + 2/lA, y, + XYl, Zs + A4, Z, + AZ], <) - F^] Z.MA, 
Jo 



Hs 



[Gy {ys + ylX, Ys + An\ z, + A^, Z, + AZ]) - Gy] yldX 

+ / [Gy {ys + 2/lA, n + XY}, Zs + A^, Z, + AZ]) - Gy] Y}dX 
Jo 

+ / [G, {ys + 2/lA, y, + XY^Zs + A^], Z, + AZ]) - G,] ^dA 

+ / [Gz {ys + 2/1 A, Ys + Ay,\ z, + Xzl, Zs + AZ]) - Gz] Z]dA. 
io 



It is easy to check that 



E 



E 



T 



T 



V! 



Hs 



ds < Ge^. 



ds < Ce^. 



E / Wn^ds < Gel. 



E / \Hfds < Gel 
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By Lemma 7, applying Ito's formula to (yt,Yt) on [0,T] , we get 

E {h (vt) - h (yr) - hy (yr) yr, Vt - Vt - Vt) 

+yUE 



\ys? + 



K 



+ \~Zs? + 



z. 



ds 



'0 

< -E y (y„v/ + i^,)ds + E y (y;,\// + //,>ds 



< e/^ 



+E 



, ,9 1 

iy,rds + E- 



T 






/i 



i; 



/^ Jo 

2 1 

ds + E- 



1 
ds + -E 
/^ Jo 



T 



H. 



ds 



T 



lK'l^cis + -E / iHsl^ds. 



A^ Jo 



Noting that by means of the same arguments in Lemma 5, from Lemma 7, we easily have 

sup (ElyH ) < C£2, 



0<t<T 



sup (E|y/r) < Ce 



Thus it is obvious that 

E/i [yr + yr) = E/i M + Ehy M yr + Ce^ , 
so by (H3) it follows that 

E {h (yr) - h (yr) - hy (yr) yr, Vt - Vt - Vt) 
= E ^/i (y^) -h{yT + yr) + Cei.yf^ - yr - Vt 
> E{y^-yT-yT) -Ce^, 



and 



E/i 



- \Vs\ H — 
2 ' ' 2 



K 



I l~ |2 



ds 



< E- 



f^Jo 



T 



v: 



2 1 

ds + -E 
^ Jo 



i/. 



ds 



+E- / |y/|^ds + -E/ |i//ds-E(yT)-Ce 
/^ io ^ io 



It is not difficult to see that E (y^) is bounded. Consequently, from that, (3.16)-(3.19) hold. 
Further using the similar arguments in Lemma 5, we can obtain (3.20) and (3.21). The proof 
is complete. □ 
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Lemma 9. (Variational inequality) Under the assumptions (H1)-(H4), it holds that 

E / [lyvl + lyY^ + kz] + IzZ] + / «) - / {ut)] rft+E [% {yr) y^ +E [7^ (Fo) Y^] > (e) 
Jo 

(3.22) 

Proof. According to the definition of u^, we liave 

J (ul)) > J (n(.)) , 



moreover 



E J [I {t, yl y/, zl Zl ul) - I {t, yt, Yt, z^, Z^, Ut)] dt 

+E [$ (2/^) - $ {yr)] + E [7 (Fq') - 7 (Yo)] 
> 0, 



or 



E [ [I {t, yl y/, zl Zl u\) - I {t, yt + y^, Y^ + y/, z^ + z],Zt + Z^ <)] dt 
Jo 

+E / [/ (t, yt + 2/^ ^t + yt\ zt + 4, Zt + Zl ul) - I (t, vt, Yt, z^, Z^ u^)\ dt 
Jo 

+E [$ (2/^) - $ (i/T + ?/t)] + E [$ (?/T + 2/r) - * (?/t)] 

+E [7 (^0') - 7 (>^o + >^t)] + E [7 (^0 + ^t) - 7 {Y^)\ 

> 0. 

By Lemma 8, it follows that 

E [ [I {t, yt, y/, 4, Z^ uf) - I [t, yt + yl Y^ + y/, z^ + 2;!, Z, + Z/, <)] dt 
Jo 

+E [$ (y^) - $ (^^ + 2/^)] + E [7 (^0') - 7 (>^o + V-t)] 



18 



while 



< E / [l{t,yt + yl Yt + Y^, z^ + z\, Z^ + Z], <) - / (t, y^ Y,, z^ ^t, «*)] dt 
Jo 

+E [$ {vT + y^) - $ (i/t)] + E [7 (Fo + V-r) " 7 (>^o)] + Cei 

= B f [I {t, yt + yl Yt + Y^ , zt + z], Zt + Z,\ li^) - / (t, ?/*, y*, zt, Zu Ut)\ dt 
Jo 

+E / / (t, y, + y\, y, + y/, Zi + ^1, z, + z/, dt 

Jo 

-E / / (t, 2/i + yl, y^ + Yl.zt + 4, Zi + Z\,ui) dt 
Jo 



+E [$ {yr + 2/].) - $ (t/r)] + E [7 (yo + Y].) - 7 (yo)] + Ce 



E 



< E 

+E 
+E 



/ {lyy\ + lyY} + /,^i + /^Z/] dt + E / [/ «) - / [ut)\ dt 
Jo Jo 

+E / { [/, «) - I, {ut)\ y\ + \Iy «) - /y (n,)] y/} dt 
Jo 

+E / { [/, «) - /, {u,)\ z\ + [Zz «) - Iz {ut)\ Z\ } dt 
Jo 

+E {% {yr) yW + E {^y {Y^) Yl\ + Ce^ 

[ [lyyl + IyY^' + hzl + IzZl] dt + E / [/ «) - / {ut)] dt 
Jo Jo 

sup \y]\ I \ly{.ul) -ly{Ut)\dt 
<t<T Jo 

SUp|y/|dt/ |/y «) -/y (Mi)|dt 

<t<r Jo 

^2«) -/^K)|Mt 



+ 



+ 



E 



E 



U.^ldt 



\lziut)-lziut)fdt 



E 



IZ/l^dt 



-E [$, (?/t) Vt] + E [7y (>^o) ^-q'] + Ce 



< E 



/ [lyyl + /yy/ + hzl + IzZl] dt + E [ [I «) - / (ut)] dt 
Jo Jo 



+ 



+ 



E ( sup \y^ 

0<t<T 



1|2 



E sup (\Yt 

0<t<T ^ 



1|2 



1 

2 


/ 

E 

\ 


f\ly{ul)- 
Jo 


-/,K)|dt 


1 
2 


/ 
E 

\ 


r ly «) - 

-Jo 


- W {ut) dt 
J 



E 



+Ce"^ ■ Gel + Ce^ ■ Gel + E [^y (yr) y'r] + E [7y (yo) Y^'] + Ce 

[ [lyyl + lyY^' + hzl + lzZ\ + / «) - / {ut)\ dt 
Jo 



1? ^r^ f„._\„M I 1? r^,__ /'v-^ v^il 



, /'^^ 



From that, the desired result is obtained. □ 

4 The maximuni principle in global form 

We introduce the adjoint equations by virtue of dual technique and Hamilton function for 
our control problem. From the variational inequality obtained in Lemma 9, the maximum 
principle can be proved by means of Ito's formula. The adjoint equations are as follows: 

dpt = {Fypt - fygt + Gykt - gyht - /y)dt 

+ {FzPt - fzqt + Gzh - gzht - lz)dWt - hdBt, 
dqt = {Fypt - fyqt + Gyh - Qyht - ly)dt (4.1) 

+ {FzPt - fzqt + G,kt - g,ht - lz)dBt + htdWt, 
V Vo = -lY iXo) , qT = -hy (vt) Pt + % (Vt) , < t < T, 

where (p(.), q'(.), A;(.), /i(.)) G R x R x R'xR'^. It is easy to verify that FBDSDE (4.1) satis- 
fies (HI), (H2) and (H3)'. From Proposition 2, we know that (4.1) has a unique solution 
[p(.),q(.),k(.),h(.)) G M^ (0,T;R x R x R'xR'^) . Now we define the Hamilton function as 
follows: 

H{t,y,Y,z,Z,v,p,q,k,h) = {qJ{t,y,Y,z,Z,v))-{p,F{t,y,Y,z,Z,v)) 

- {k, G {t, y, Y, z, Z)) + (/i, g (t, y, F, z, Z)) 
+l{t,y,Y,z,Z,v), 

(4.2) 

where H : [0,T] xR x R x R'xR'^xR x R x R x R'xR'^^ R. (4.1) can be rewritten 

as 

' dpt = -Hydt - HzdWt - ktdBt, 

(4.3) 



dqt = -Hydt - H.dBt + htdWt, 



PO = -lY {Yq) , 

qr = -hy {yr) Pt + $, {vt) , < t < T. 
From Lemma 9 and (4.2), we can obtain the main result in this paper. 

Theorem 10. Suppose (H1)-(H4) hold. Let (y(.), Y(.), 2;(.), Z(.),M(.)) be an optimal control 
and its corresponding trajectory of (2.1), (p(.), g(.), A;(.), /i(.)) he the corresponding solution of 
(4.1). Then the maximum principle holds, that is 

H (t, yt, Yt, zt, Zt, v,pt, qt, h, ht) 
> H (t, yt, Yt, Zt, Zt, Ut,pt, qt, h, ht) , 
Vf G U, a.e, a.s.. 

(4.4) 
20 



Proof. By applying Ito's formula to {pt, Y^^) + {qt, yl), and noting the variational equation 
(3.1), the adjoint equation (4.1) and the variational inequality (3.22), we get 



E [% (yr) y'r] + E [7^ (^0) Y,'] 
+E 



; / [lyyl + WYl + hz] + IzZ] + / «) - / {ut)] df 
Jo 



= E / [H {t,yt,Yt,Zt,Zt,ul,pt,qt,kt,ht) - H {t,yt,Yt,Zt,Zt,Ut,pt,qt,kt,ht)]dt 

Jo 
> o{e). 

Since £ > can be arbitrarily small, from the above inequality, (4.4) can be easily obtained. 
The proof is complete. □ 

In the last part of this section, we provide a concrete example of forward-backward doubly 
stochastic LQ control problems. We give the explicit optimal control and validate our major 
theoretical results in Theorem 10. 

Example 11. Let the control domain helA = [—1, 1] . Consider the following linear forward- 
backward doubly stochastic control system which is a simple case of (2.1). We assume that 

l = d=l. 

dyt = {zt - Zt + Vt) dWt - ZtdBt, 

dYt = - {zt + Zt + Vt) dBt + ZtdWt, (4.5) 

1/0 = 0, rT = 0, tG[0,T], 

where T > is a given constant and the cost function is 

J (v^.)) = 1^1 {Vt + y' + ^t + Z^ + Vt) dt + ^Ey^ + IeyI (4.6) 

Note that (4.5) are a linear control system. According to the existence and uniqueness for 
(4.5), it is straightforward to know the optimal control is «(.) = 0, with the corresponding 
optimal state trajectory {yt,Yt, Zf, Zt) = 0, t G [0,T]. Notice that the adjoint equation 
associated with the optimal quadruple {yt, Yt, Zt, Zt) = are 

dpt = -Ytdt + {h - Zt) dWt - hdBt, 

dqt = -ytdt + {kt - Zt) dBt + htdWt, (4.7) 

Po = 0, qT = 0, te[0,T]. 

Obviously, {pt, qt,kt, ht) = is the unique solution of (4.7). Instantly, we give the Hamilton 
function is 

H (t, yt, Yt, Zt, Zt, V, Pt, qt, h, ht) = - {yt + Y^ + zj + Z'f + v'^) 

-kt {zt + Zt + v) 

+ht {zt - Zt + v) 
1 



2"^ 
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It is clear that, for any v G W, we always have 

H{t,yt,Yt,Zt,Zt,v,pt,qt,kt,ht) > H {t,yt,Yt, Zt, Zt,Ut,Pt,qt,kt,ht) = 0, a.e, a.s.. 

5 Applications to optimal control problems of stochastic 
partial differential equations 

Let us first give some notations from [14]. For convenience, all the variables in this 
section are one-dimensional. From now on C^ (R; R) , Cf^ (R; R) , C^ (R; R) will denote 
respectively the set of functions of class C^ from R into R, the set of those functions of 
class C^ whose partial derivatives of order less than or equal to k are bounded (and hence 
the function itself grows at most linearly at infinity), and the set of those functions of class 
C'' which, together with all their partial derivatives of order less than or equal to k, grow 
at most like a polynomial function of the variable x at infinity. We consider the following 
quasilinear SPDEs with control variable: 



u (t, x) = h {x) + J^ [Cu (s, x) + f (s, X, u (s, x) , {yua) (s, x) , Vs)] ds 
+ /^ (yf (s,x, M (s, x) , (Vmo") (s, x)) d_Bs, < t < T, 



(5.1) 



where u : [0,T] x R — )> R and Vu{s,x) denotes the first order derivative of u{s,x) with 


respect to x, and 




/ Lui \ 


Cu = 


'. 5 


\Luu j 


with L(j) (x) = I Ei,j=i i.(^(^*)ij i.^) dxtdxj + T.i=i bi ix,v) 'f^\ In the present paper, we set 


(i = A; = 1, and 


b 


R X R ^ R, 


a 


R^R, 


f 


[0,r] X Rx Rx Rx R^R, 


9 


[0,T] X Rx Rx R^ R, 


h 


R-^R. 





In order to assure the existence and uniqueness of solutions for (5.1) and (5.3) below, we 
give the following assumptions for sake of completeness (see [14] for more details). 

(Al) 

b e Cf^ (R X R; R) , ae Cf^ (R; R) , he C^ (R; R) , 
/(t,-,'-,-,t^)eCf,(RxRxR;R), f{-,x,y,z,v)eM^O,T;R), 
g{t,-,-,-)eCl,{RxRxR-R), g {■,x,y,z) e M^O,T-R) 

Vt e [0,T] , x e R, y e R, z e R, V e R. 
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(A2) There exist some constant c > and < a < 1 such that for all {t,x,yi,Zi,v) G 
[0, T] X R X R X R X R, (i = 1, 2), 

\f{t,x,yi,zi,v) - f{t,x,y2,Z2,v)f < c{\yi -2/2!^ + \zi -22!^) , 
\g{t,x,yi,zi) - g{t,x,y2,Z2)f < c\yi -y2f + a\zi - Z2\^ . 



Let Uad be an admissible control set. The optimal control problem of SPDE (5.1) is to 
find an optimal control , such that 



where J {v(.)) is its cost function as follows: 



J (v^.)) = E 



/ (s, X, u (s, x) , (Vmct) (s, x) , Vs) ds + 7 (m (0, x)) 



IJG 



(5.2) 



Here we assume I and 7 satisfy (H4). We can transform the optimal control problem of 
SPDE (5.1) into one of the following FBDSDE with control variable: 

X*'^ = x + j"b {Xl'\ Vr)dr + // a (X^'^) AWr, 

y,*'" = h [X'f) + /J / (r, Xl'\ Y^:\ Zl'\ Vr) dr + /J ^ (r, X;•^ y,*'^ Z^-") dS, (5.3) 
-/Jz*'^dlK, 0<t<s<T, 

where ( X/^ ^ ^(.f 1 '^f-T' "^(O ) GRxR-xRxRja;GR. The corresponding optimal control 
problem of FBDSDE (5.3) is to find an optimal control f f -, G Uad-, such that 

"^ (''(■)^ ^ .Hi -^ ^""(-^^ ' 

where J (f(.)) is the cost function same as (5.2): 

V(.)&Aad 

Now we consider the following adjoint FBDSDEs involving the four unknown processes 
{pt,qt,kt,ht): 



dpt = UyPi + grh - W) dt + {fzPt - Qzh - h) dWt - hdBt, 
dqt = {fxPt - bxQt + gxh - CTxht - Ix) dt + htdWt, 
Po = -lY (^0) , Qt = -hx (Xt) Pt, 0<t<T. 



(5.4) 



It is easy to see that the first equation of (5.4) is a "forward" BDSDE, so it is uniquely solvable 
by virtue of the result in [14]. The second equation of (5.4) is a standard BSDE, so it is 
uniquely solvable by virtue of the result in [13]. Therefore we know that (5.4) has a unique 



23 



solution (p(.), g(.), /:;(.), /i(.)) G M^ (0, T; R x R x R x R). Define the Hamilton function as 
follows: 

H {t,X,Y, Z,v,p,q,k,h) = H (t,X,Y,0, Z,v,p,q,k,h) 

= l{t,X,Y,Z,v)-k-g{t,X,Y,Z) 

+q-b{X,v)-p-f (t, X,Y,Z,v) + h-a (X) . 

(5.5) 
We now formulate a maximum principle for the optimal control system of (5.3). 

Theorem 12. Suppose (A1)-(A2) hold. Let (X(.), Y(.), Z(. ),«(.)) he an optimal control and 
its corresponding trajectory of (5.3), (p(.), g(.), A;(.), /i(.)) he the solution of (5.4)- Then the 
maximum principle holds, that is, for t E [0,T], \fv eU, 

H{t,Xt,Yt,Zt,v,pt,qt,kt,ht) > H (t, Xt.Yt, Zt,v*,pt,qt,kt,ht) , a.e., a.s.. 

Proof. Noting that the forward equation of (5.3) is independent of the backward one, we 
easily know that it is uniquely solvable. It is straightforward to use the same arguments in 
Section 3 to obtain the desired results. We omit the detailed proof. □ 
From the results in [14], we easily have the following propositions. 

Proposition 13. For any given admissihle control f(.), we assume (Al) and (A2) hold. 
Then (5.3) has a unique solution te'J", Y^^;^ , Zf.'J') G M^ (0, T; R x R x R). 

Proposition 14. For any given admissihle control V(^.), we assume (Al) and (A2) hold. Let 
{u{t,x) ;0 < t <T,x E R} he a random field such that u (t, x) is J-'fj,-measurahle for each 
(t, x),ue C°'2 ([0, T] X R; R) a.s., and u satisfies SPDE (5.1). Then u (t, x) = F/'"^. 

Proposition 15. For any given admissihle control f(.), we assume (Al) and (A2) hold. 
Then [u (t, x) = Y^ '^ ; < t < T, x E R} is a unique classical solution of SPDE (5.1). 

Set the Hamilton function 

H {t^x,u,Vua,v,p,q,k,h) = l{t,x,u,Vua,v) — k • g{t,x,u,Vua) 

+q ■ b{x,v) — p ■ f (t, X, u, Vua, v) + h ■ a (x) . 

Now we can state the maximum principle for the optimal control problem of SPDE (5.1). 

Theorem 16. Suppose u{t,x) is the optimal solution of SPDE (5.1) corresponding to the 
optimal control f f n of (5.1). Then we have, for any v ElA and t G [0, T] , x G R, 

H (t, X, u (t, x) , (yua) (t, x) , V, pt, qt, h, ht) 
> H{t,x,u{t,x) ,{Vua){t,x) ,Vt,pt,qt,kt,ht) , a.e., a.s. 
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Proof. By virtue of Proposition 13, 14 and 15, the optimal control problem of SPDE (5.1) 
can be transformed into the one of FBDSDE (5.3). Hence, from Theorem 12, the desired 
result is easily obtained. □ 

Remark. In Section 5, we study the optimal control problem of a kind of quasilinear 
SPDE which was similar to the SPDE considered by 0ksendal in [12]. It is worth mention- 
ing that the quasilinear SPDEs in [12] can also be related to a class of partially coupled 
FBDSDEs. Consequently the results in [12] can be obtained by the approach of FBDSDEs. 

6 Linear quadratic nonzero sum doubly stochastic differ- 
ential games 

In this section, we investigate linear quadratic non zero sum doubly stochastic differential 
games problem. Under the framework of uniqueness and existence result introduced above, 
we improve similar result in Hamadene [11] and Wu [27]. For natational simplification, we 
only consider two players, which is similar for n players. Now the control system is 

r dxl = [Ax"^ + B^vl + B^v^ + Ck^ + at] dt + [Dz^ + Ek^ + /3J dWt - kfdBt, .„ ^ 
\xl = a, tG[0,r], ^-^ 

where A, C, D and E are n x n bounded matrices, further, E satisfies < \E\ < 1, vj 
and vf, t E [0, T] , are two admissible control processes, that is J-'j-progressively measurable 
square integrable processes taking values in R''. B^ and B^ are n x k bounded matrices, at 
and j3t are two adapted squares-integrable processes. We denote by 






f^HR'xlx^,) + {N^vlv^) + {P'klk^))dt+{Q^xJ^,xl^) 



(6.2) 



Here Q^, R\ and P*, i = 1,2, are nxn nonnegative symmetric bounded matrices, A^^ 
and A^^ are kxk positive symmetric bounded matrices and inverses (A^^) , {N"^) are also 
bounded. We denote v (■) = {v^ (■) , v"^ (■)) . The problem is to find [u^ (■) , u^ (■)) E R^ x R^ 
which is called Nash equilibrium point for the game, such that 



J2 («! (■) , u^ (■)) < J2 (^ii (.) , v^ (.)) , v^ (.) e RK 



(6.3) 



Note that the actions of the two players are described by a classical BDSDE in which we 
indicates that the players should make some strategy to overcome the disturbed information. 



25 



In order to introduce the main result, we need the following assumptions: 

,-1 



:b' 



)'^^T _ AT 



A^B'iNT'iB'f 



(B'f C^ = C^B' {N' 



< 



B'{N' 

B'{N' 

B^ {N'y^ {B'f D^ = D^B' {N' 

B'{N'y\B 

B' {N'y^ {B'fP^ = P^B' {N' 



'Ub'V 



r'iB'f 



{B' 



xT 



B' {N') {B'y P2 = p2^i (^i) (^i 



I ■ 

i 

i 

i 

i - 
i - 



1,2, 

^1,2, 

= 1,2, 

^1,2, 

1,2, 

1,2, 



(6.4) 



Next we give an explicit form of Nash equilibrium point by virtue of solutions of linear 
FBDSDEs. Hence we have a following theorem. 

Theorem 17. The pair of function 



u\ = - {N^y\B^f yl 



tG[0,T] 



is one Nash equilibrium, point for the above game problem, where {xt, yl, y^, kj, kf,hl,h 
is the solution of the following differential dimensinal FBDSDEs: 



dxt = 


'Ax, - B^ (iVi)-i {B^fyl - B' (iV2)-i (^2)^^^ + ^; 


dt 


dy] = 
dy't = 

^ XQ = a 


[Cxt + A] dWt - hdBt, 

- 'Ayl + D^h\ + R^xt] dt - [C^y] + E^h\ + P^h) dBt + h\dWt, 

- "Ayj + D'^h^ + R^xt] dt - [C^yj + E^h^ + P^h) dBt + h^dWi, 

Vt = Q^xt, yr = Q^xt- 



(6.5) 



Proof of Lemma 2. At the beginning, we prove the existence of the solution of (6.5). 
Consider the following FBDSDEs: 



f dXt = {AXt -Yt + at) dt + [CXt + A] dWt - K^dBt, 
dYt = - (^A^Yt + ((51 (N'y') (B^f R' + (Si (N'y' 
- [C^Yt + E^Ht + PKA dBt + HtdWt, 



:B^fR^]Xt + D^Ht]dt 



Xn 



a, 



Yt 



B' (iV^)"M (B'fR' + (b' {N'y') {B^fR' 



Xrr 



(6.6) 

Apparently, if the {xt, yl, yt, k], k^, h\, h^) is the solution of (6.5), then {Xt, Zt, Yt) satisfies 
the FBDSDEs (6.6) with (6.4). Here 



Xt — Xt, 
Kt = kt, 
Yt = B^ (N^)'^ {B 



Ht = 51 (A^ 
P = P^B^ (A 



1^-1 



B 



rn-l 



'fyl- 



B 



l\T 



B^NrHB')^y^ 
- b\n^)-\b^^^ ^^ 

p2Q2 (^2 



'h 1 



'fS^f , 
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As matter of fact, it is easy to check that there exits a unique solution {Xt, Yt, Kt, Ht) of 
(6.6) according to Proposition 2. Hence we can first solve the FBDSDEs (6.6) to get solution 
{Xt,Kt) which, obviously, is the forward solution {xt,kt) of (6.5), then {yl,h\) and {yf,hf) 
are obtained. Now consider the following classical backward doubly stochastic differential 
equations (BDSDEs in short) with four unknown processes {y^, yfjhj, h'f): 

dy} = - [A^yl + C^h] + R^Xt] dt - {C^yl + E'^h\ + P^h) dBt + h]dWu 
d?/2 = - [a^2/' + C^h'i + R^Xt] dt - [C^y^ + E^h^, + P^kt) dBt + h^dWt, 



yt 



Q'Xt, y^ = Q^Xt. 



Set 




B'{N' 



[B' 



B'{N'f^ 
after simple computation we have 



\^ 1 



B'fhl 



B^N^r'iB'fyl 
B^N^f\B^fhl 



dYt 



Yt 



\T 



A^Yt + B^ {N^y (B^y R^ + B^ (N^y' {B^ R^)Xt + D^Ht 



2\-^ fu2\T 



[C^Yt + E^Ht + PKt] dBt + HtdWt, 
B' (N'y^ {B'f i?i + B^ {N^y' {B^ R' 



Xn 



dt 



Now fixing {Xt}t>Qi ^"^^ thanks to < \E\ < 1, due to the existence and uniqueness of 
solution of BDSDE, we immediately have 




B'{N'y\B'fyl 



B^ (ivi; 



:b^y hi 



B^{N^y\B 
- B^ {N^ 



^ yt 



' (B'f 






No doubt, (X(, Fi, Kt-, Ht) satisfies the FBDSDEs (6.6) and is the unique solution. There- 
fore {xt,yl,yt,kl,k'f,hl,h'f) is the solution of FBDSDEs (6.5). From now on we prove 
{u^ (t) , u"^ (t)) is one Nash equilibrium point for our nonzero sum game problem. For that it 
suffices that 

J' K (■) ' ^' (■)) < J' {v' (■) , u' (■)) , V^;^ (■) e R\ 

It is similar to give the other inequality by the same argument. Next we give the control 
system by x^ : 



dxf = 


Axf + B^vl + B'^ul + Ckf + at 


dt + 


xo = a, 


t G [0, T] , 





Cxf+f3t]dWt-kfdBt, 
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-nj {(^R^xf^xf) - {R'xt,xt) + (N'vlvl) 
- (N'ulul) + i^P^kf^kf) - {P'h,h)^ dt 
+ i^Q^xi ,xi^ - {Q^xt^xt)] 

(R IXf — Xtj ,Xf — Xf) 

''+{N^[v]-u\)M-u\) 

+ (pi [kf - k^ , kf -h)+2 (^R'xt, xf - xt 

+2 {N\], v] - u\) + 2 (P^h, kf - kM dt 

+ \Q^ i^T ~ ^t) ,Xt - Xt 
+2 (Q^XT,xf -XT 



1 f"" 



Note that 



Q^xt = Vt- 
We apply Ito's formula to ( x^ — Xt, Vt) on the [0, T] and get 



E(^xlf-XT,y'T) = EJ [-{R'xt,{xf-xt)) + {B'{vl-ul),yl) 

'P'h,kf -k))dt. 



Under the assumption R^, Q^ and P^ being nonnegative, A^^ being positive, and sym- 
metry oi B^, we have 



> e/ {{N\lvl-ul) + {B'{vl-ul),yl))dt 
Jo 



^[ [{-N' [Ny' [B^fylM-ufj + {[B^Yylvl-u])) dt 
0. 



Lastly, we claim that 



u\ = - {Ny\B'f yl 

ul = - {Ny\B'f yl tG[0,T], 
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that is, {ul,uf) is one Nash equihbrium point for our nonzero sum doubly stochastic 
game problem. □ 

Remark 2 As matter of fact, in Theorem 17, we use the adjoint equation, the idea is the 
same as in Theorem 10. Besides, the results of this section are clear and easy to understand. 
They can be applied in practice directly. 

Acknowledgment: The authors would like to thank the referees for their helpful com- 
ments and suggestions. 
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